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The SPADE theory, which usei? lingAiistic fora'alis^s to 
■odel the planning and debugging p;rocesses of computer prograaaing. 
If as sitftiltan^nsly developed and tested^ in thr^e separate^ 
contexts — coiputer' uses in education, ^ autqaatic prograaaxng (a 
traditional artificial intelligence arena), and protocol analysis 
(the doaain of idforaation prqcessing ,psychologi) • in the educatioil 
context, an editor has been iapleaented that encourages stude^nts to 
define and debug programs in teras of explicit design choxc^s. The 
editor, provides a i^ructured prograaaing env^jKina^ilt based oa a 
detailed theory of the processes inrolvec^in roherently structured • 
problea solving. Jn the AI context, anautoaatic prograarer called, 
PATH was designed using an augaented transition network eabodiaent 'of 
the SPADE theory. This resulted ifc a unified fraaework wiixch • , 
clarified^worjc on planning and debufjging by Sacerdoti ana *Sus*an. 
the psychology context, ^ parser called PAZAfTH has been ^^esigned tha't 
applies* the SPADE theory to' the analysis of prograaaing protocols to 
produce a parse delineati;ag the planning and debugging strategies 
used by the problea' solvers. Hand*siaulations^of PATH and PAZAIN on 
el^eaentafy prograaaiag problems and infqraal experiaents with the 4 
SPADE editor demonstrate t^e effectiveness of the theory-in 
accounting for a wide range of planning and debugging techniques. 
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Tht 9PA0E theory uses linguistic forMllsas to aodel the prograa plannlno 
. end debugging processes. The thorory hes been applied to constructing e 
grMMr-based editor/ in* which pr-ogreas ere written In e structured fashion* 
designing ah autoMtlc programing systea based on an Augnented Transition, 
Network » and parsing protocols of programing episodes. 

' The SPADE theory begins with a taxonoay of^aslc planning concepts 
covering strategies for identification^ dejcoaposltlon ' and. reformilatlon. A 
handle ^Is provided for recognizing Interactions l|etween goals and Striving a 
Unear solution. * " 

- A ^ovpleaentary theory of. rational bugs and associated repair. techniques 
. Is also provided. SPADE introduces a new data structure to facilitate * 
debugging the derlva\^on tree of the pi(ogran.* The SPADE editc/r Mkes this 
structure available to the programer. 




The SPADE theory generalizes recent work in Artificial Intelligence by 
Sussaan an^ Sacerdotl on aiitoaatic prograHlng, anci extendi Jthe theory of 
prograa design (||Sveloped by the Structured Programing aovemnt.^ It provides 
.a Bore structured infonaation processing aodel of huaan problea solving thi^ 
the' production sytteas of Newell and Siaon, and articulates the ty;pe of 
problea solving cvrricuiua advocated by Papert's Logo/ Project. ^ 



This report describes resliarch Jdne at the Artificial Intelligence Laboratory of 
the Massachusetts Institute of Tecfmology. The autoaatic problea solving aspect of 
this research was supported* bv the Advanced Research Projects Aaency of the Departaent 
of Defense under Office of Naval Research contract N00014-7S-C-i0643, the educational 
vspect by thi| National Science Foundation under grant C40708X» and the protocol 
analysis aspect by the Intelllaent Instructional Systeas Group at Bolt Beranek and 
Newaan» under .contract nuaber HdA 903-76-C*&108 Jointly sponsored by Advanced Risearcn 
Projects Agency, A^r Force Huaan J^esources Laboratory, Aray Research Institute* and 
Naval Personnel Research ft Developaent Center. 

* 1 ' 

*Thls is" an- expandec) version of |i paper aubliitted to the Fifth International Joint 
Conferepce on Artificial Intelligences 
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TW« SPAPE TiMory, ' 2 - - Rlller * Goldstein 

1. A Hultl-'Faceted Approach ^ 

This paper provides «n overview of three «separatfe contexts In which the SPADE 
^theoit'y is being simultaneously developed and tested computer uses In educatldn. 
autpMtlc programing (a traditional AI arena),, and protocol malysls (the doMln of 

onforMtioh processing psychology) « Our experience *has been that a powerful syneroini 

• , • * ) 

results froii this /iMilt^-faceted approach. * . . 

, l\ The Education Context: an editor has been lapleaented that encourages students 
%to <lerine and ^debug programs In terms explicit §PADE design choices. The aditor 
provides a structured programing environment based on a detailed theory of the. 
processes Involved in coherently structure^' problem solving. 

2. The AI Context : an automatic prograomer called -PATH has been designed usihg an 
augmented transition network embodiment of the SPADE theory. This results In a unified 
framework which clarifies recent work on planning and^ debugging by Sacerdotl 1 197S] and 

Sus^man [1975]. 

* ' ^ * • > 

3* The Psychology Context: a parser called PAZATN has been designed that applies 
the SPADE theory to the analysis of programming pr^otocols. PAZATN produces a parse of 



the prptocol^hat (t^llneates the planplng^ and debugging strategies employed by the 
problem solver. PAi^TN extends the series of automatic protocol analyzers developed at 
Carnegle-nellon iJrv^verslty [Waterman & Newell 1972» 1973; Bhaskar Sli[g|r'l976].. 

Hand-simulations of PATN and PAZATN on elementary programming problem^ and 
informal experiments with the SPADE editor attest to the theory'^ cogency in accounting 
for a wide range of .planning ^nd debugging techniques [Goldstein ft Hiller 1976a, b; 
Hiller ft Goldstein 1976b»c»d]: * , * 

^ ^ 2. A Linguistic Analogy 

In developing a represention for probleii solving techniques, we^have been guided 

by an analogy to computational lingulstlci« for three reasons. 

.... 

% 1. The concepts and* algorithm^ 6f computational ll^iguisticSi though originally 



The SPADE Thepry • ^ 3 Hiller A Goldstein' 

Intended to explain thti nature of Isngu&ge per ie, supply perspicoous'yet powerful 
descriptions of fcomplex coa^utatlonj in general. Problea solving, as a conpl^x 
process, benefits froa the ap*plic«ition of these tools. 

2. CoBputational' linguistics decomposes coeputrfliony into syntactic' semantic, and 
pragmatic components. This decomposition clarifies the explanation of complex 
processes when viewed in the following ntenner: . syntax formalizes the' range of possible 
decisions; semantic^ the problem deSckption. and pragmatics ttTo procedural 
relationship between the two. * 

/• • . - • , 

3. computational linguistics has undergone an evolution of procedural formalisms, 
beginning with finite state automata, later employing recursive transition networks 
(cont«txt free grammars), next moving on to augmented transition networks, and » 
culminating in the current set of theprtes involving frames [Hinsky ^975, ^ 
Wtnograd 1975.- Schank 1975]. Each phase captured ^e properties of language, but was 
Incomplete and required generlalizatidn to more powerful and elaborate formallsis. 
Following this evolutionary sequence illuminates the complexity of language theory. We 
have pursued a similar evolutionary approach to clarify the complexity of problem 
solving processes. 

To date, oyr theory of design >as evolved through the following stages: we 
Initially explored context free grammars for planning and debugging, and subsequently 
their generalization to ATN's;- we ex^ined the metaphor of protocol analysis as 
parsing, initially using the planning artd debugging grammars to reveal the constituent 
structure of protocols and later using the. derivations produced by the ATN formallsa; 
and. finally, opr most recent work has studied the use of a chart-based parser, to 
discover, these analyses,. • ' • 

J J. A Graamiatical Theory of Planning 



The basis for SPADE is a taxdnomy o£. frequently observeT -planning concepts 
(fig: 1), We arrived at this taxonomyjjy introspection, by examining problem solving 
protocols [Hiller ft Goldstein 1976b], "by studying the llteC4ture on problem • solving 
[Polya 1957, 1965," 1968; Newell ft Simon. WZ; siissman 1975; Sacerdoti 1975]. and by 
enumerating techniques for finding procedural solutions to problems expressed as 
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PLAN 



IDENTIFY- 



— DECOMPOSI 



PmMITIVE 



_ PREyiau^LY DEFINED I^ROCEDURE 



ULINEAR 



:ONJUNCTION 



-NOV^LINEAR 



— REPETITION- 



-ROqND 



-RECURSION 



-JIEGROUP 



— EQUIVALENCE — 



REFORMULATE- 



"GENERIC <-> EXPLICIT 



-SPECIALIZE 



— SIMPLIFY- 



7GENERALIZE 
-ANALOGY 



^•IGURE 1 
TAXONOMY OF PLANNING CONCEPTS 
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prei^lcate calculus foVnulae (Enden & Kowalski 1976].. This last criterion demonstrates 
that the taxonomy is currently incomp.lete for example, techniques for handlino 
disjunctions have not yet been analyzed thoroughly enough to warrant incjiision. 
However, the taxonomy Is adequate for a wide range of elementary j^rogramning^ probli 
Future research will investigate additional planning techniques. 



There are three majdr classes of plans in the taxonomy: identification* 
decomposition, and reformulation. Identification means recognizing a problea i^s 
PFV^vImjsly solved. Decomposition refers to strategies for dividing a* problem into 
^ImoZer sub-probl^ems. Reformulatioq plans alter the problem description, seeking m 
Representation which is more amenable to identification or decomposition 



The figrurm 



indicates how these classes of plans are further subdivided in the SPADE TKeohy* 

Planningrv^&GMtiling to the theory, is a process in whicfi the problem so'lver 
selects the appropriat^^^^Hajn type,\^d then carries out the subgdals defined by that 
plan applied to the current problem. From this viewpoint, the planning taxonomy 

r j 

represents a decision tree of alternative plans. The decision process can be aodel^il 
by the context free gremnar given below. The grammar explicitly states which planning 

rules inv&lve recursive' application of solution techniques to subgoals: setup, 

f 

interface, mainstep, cleanup, and parallel. 



(The rules of the granoar are written usin^ the following syntax: "|" is 
disjunction, ' 
■< 

enclosed in quotation narks (e.g., 'repeat step") describes a lexical itei 
which is not further expanded in the grannar.) 



^ is ordered conjunction, is unordered conjunction, 
> is iteration, [...] is optionality, and a lower case English phrase 



PLAN 

IDENTIFY 

DEFINED 

DECOnPOSE 

CONJUNCTION 

SEQUENTIAL 

PARALLEL 

SETUP 



-> IDENTIFY I DECOnPOSE I REFORHULATE 
-> PRIMITIVE I DEFINED 

-> "call user iubprocedure" 6k PLAN . ^ 
-> CONJUNCTION \ REPETITION 

-> SEQU^TIAL I PARALLEL f 
-> [5ETUP>>MHAIN5TEP ♦ [INTERFACE']/ ♦ [CLEANUP] 
-> <PLAN>* 

-> PLAN \ • 
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HAtNSTEP 

INTERFACE 

CLEANUP 

&EPE)TITION 

ROUND 

ITER-PLAN 

TAIL^ECUR 



•> PLAN' 

•> PLAN . / 

-> PLAN 

•> idbUND I RECURSION 

•> ITER-PLAN r.TAIL-RECU|l 

O * repeat stepf ♦ SEQ 

•> "stop step* ♦SEQ ♦ "recursion step* 



The^ SPADE theory is not res/tricted to ^any particular donain. . However, to provide 
concrete exaoples, we have concentrated on problems froa eleneiTtary Logo graphics 
programming [Papert 1971]. ^ This domain was chosen because of the availability of 
extensive dat^on the perfomance of students writing "turtle" programs to draw simplr 
pictures. Tire grammar rules for primitives in this tlomain arer 

-> VECTOR I ROTATION | PENSTATE • , 

-> (FORWARD i BACK) * <mnber> 

^ ■-> (LEFT I RIGHT) ♦ <nu«ber> 

-> PENUP I PENDOWN 



PRiniTIVE 
VECTOR 
ROTATION 
PENSTATE 



r 



A typical task undertaken by beginners in the Logo environnent is to draw a wlshingwell 



logo er 



picture using the computer. 



/ 




^ • r 

Fig. 2 — A Logo WishiRgwkll 



' Fig. 3 illustrates a solution, to the , wish ingwel^ problea with it^hi^archicil 
annotation according to our planning graaaar. 

The gramir l^aracterizes the decision ' process involved In ' selecting plans Trom 
the taxonopiy. We illustrate Its utility* it^ the next two sections by constrtretlofl an 
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-SETUP — .\ .IDENTIFY PRIMITIVE- 

-MAINSTEP (WELL) . .-DEFINED . 



SOLVgCWW) PLAN DEC 



SEQ 



— IN^ERFXCE . . . DEC 



MAINSTEP (POLE)—. •-. IDENTIFY" 



— INTERFACE- 



•-mXinSTEP (ROOF)— • 



DEF 



NEd 



CON J • • SEQ 

■PRIMITIVE . 

r- SETUP,. .' 
-§EQ -UlAINSTEP 
CLEANUP 



repetition 




repetition 



FIGURE 3 PAT 
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EOl ? TO WW 

E02 >10 RIGHT 90 ' 

E03 >20 >rELli 

E04 '>3(J FORWARD 50 

EQS >40 LEFT. 90 

E06, >50 FORWARD ioO 

E07. >6G LfeFT 90. 

EOS >70' FOPtWARD 50 

E09 >8,0 SlGftT 120 • 

ElO->90 ROOF 

Ell >END ' ' 



E12 ? "PO'-WELL 

E13 >10 REPE^^T 4 [20 30] 

E14 >20 FORWARD -100 

E15 ,">30 RIGlfi 90 

Eie >END 

El 7 ? TO ROOF 
E18 >10 REPEAT la {20'30J 
El 9- > 20' FORWARD 100 . 
■E2& >30 RIGHT 120 
E21 '>END 



DERIVATION TREE FOR THE WISHlNGWELL TASK 
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editor that embodies the grapnar and analyzing debugging in terms of ^he grammar. Then 
we show how, the graupnar can be augmented to include not only the syntax, of plans, but 
their semantics and pragmatics as well. ^ * s . , 

4, SPAOE^, A Planning Assistant 

One reason for cMLin^our theory of planning and . debugging structurejtf i% to 
emphasize the linK between ouV research and the' Structured Programming movement. Dahl* 
DlJ|tstra," and Hoare [1972] call for a style of programming which reflects coherently 
structured problem splving. But a' detailed formalization of what this style entails Is 
lacking. Our efforts in this direction, therefore, supplement the work of Dijkstra and 
others. 'The SPADE-0 editing environment serves as an example. 

How can we Judge whether a particular gramar of plans captures »/^at some leVel of 
"abstractionp the set of planning decisions involved in solving problems for^ soma 
domain? One methodology we employ is to incorporate the graamar into an editor (SPAOE* 
0) whose purpose is^^to augment and direct the capab^ties of a human user. The 
critical question then becomes determining the ^exteat to which such a system aids or 
hinders the userx ^ 0 

y Suppose a problen solver Is defining a Lego prograa'for drawing the wishingwtll 
shown earlier. In SPAde-0, this is acconplished by applytnf-*W planning graMMr in 
generative node: ' ' 

la. What is the naae of your top level procedure? 
lb. >ww 



> 



2a. The rule is: PLAN -> IDENTIFY | DECOMPOSE | REFORNULATE . 

Vnat now? \^ 
2b. >DEC0nPOSE. 
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3a. The rule is: DECOHPOSE .-> CONJUNCTION | REPETITION 
3b. CONJUNCTION 

4a. The rule is: CONJUNCTION -X {(EQUENTIAL. 

* • - . * (' 

9Z. ' .12 



.Tht SPADE Theory * "'v '^ V ^9 * A ' ' , HilWr » Qoldsttin 

. The ritle'is: SEQUE»?TIAL r> [SEtUl'I* <HAiNSTEP ♦ [INTERFACE])* ♦ [CLEANUP]. 
, * :pb you wish to dcf^n^. an optional SETUP? , « . 

4b. Later. * 

• : ; ■ \-, • -.^ . 

Jn t^l^ Vay/SMB£<^ ^ilt^urages users to articulate their^ design declsion^^ in >op* 
down or(Wr. At ^he sane tlM, the sys-ten illcms the user to escape froii this s^trict 
itiscipline if an alterjintivt solution order seens prefifrable/ TMs was illustrated hy^ 
the user^s ""later" instruction. "Later" suspends the; current goal for later * solution* 

SPAbE-0 was inplemdnted by^assignirvg an interpretive procedure to each gfanatical 
operator. In essence. th« edltor'i^ a bookkeeper Tor the useff'goal tKee. Despi.tt 
, its simplicity,, we see three useful ^applications of the program. . 

1. From an educational standpoint » the editor encourages students to- articulate 
their problem' solving strategies. IrThe fiindanleotal hypothesis of the Logo Project* ae 
presented" by Paper^ in Teahhing Chiliref; Tbiiikinf [1971], is ^at such articulate 
probl^em solving is beneficial to tlte learner. The SP^DE editor, with its extreme form 
„^ 'erticulatiqn, pfovijles an^xperimental vehicle for evaluating >apert's claim: do 
students exposed, to SPADE progress fAt^r in learning Logo than controls whose probltai 
solving is more tacit? 1 



2. From a/ Af^tandpoint, its use will indicate whether the iHanning ot^uMr ^ 
adequ^e, or mether. certain* plans lire not present tliat .competent problem solvers feel 
ar^ necessary* . . .^y 

a. From a psychological standpoint i we will collect transcripts of individuals 
usinfliglfca^editor and foHaulata^ersoffat grummrs based on the particular rules usually 
employffifty eagi user. The perj(onal graenar will model the problem solving sKilla of 
t|<at individual. > In the past we haVe manually analyzed protocols from stan^iard Logo. 
*SPAPE protocols, with their explicit planning choices, cin be l^ar more revealing. 




«**AM TKm^ ' 16 Hllltr It Goldstaln 

5> MID, A PebuHfllin; Astlstant *^ 

SPApE- Includes a theory of debugaino. Such 'a theory Is essential, slnco problM 

solvani aust often foraulate plans in the face of laperfAt knowledoe and Halted 

resources. Under such clrcifastances,* eyen carefully reasoned Judgaents aay be 
alstaken. *; . 

Given a yraMtttlciil theory of planning, debugging can be analyzed as tha- 

locallzatlon and repair of.erronffli applying graaaar rulii during plannlifg. Slnca our 

♦ 

planning rules were coaftructed Troa operators for conjunction » disjunction, and 
optionalltyt three basic classes of errors ^rlse: 

1. syntactic bugs» In whieh the basic graaaar Is- ylolatid» such as Krhen a^ 
required coayunct Is'als^lng; 

Z. seaantlc bugs, In Which a seaantlc constraint arising froa the particular 
problea is violated p such as^when a syntactically optionQl constituent, needad 
because of the seaantlcs of the pArtibular problea, is alsslng; 

3. pragna^lja bugs, in which an InljjLprlate selection' froa a set of autually 
axciusli^ iili3)(fitcU 'is aad#'. I^HSr 

Fifi. 4^rovld«iS iBxaaples AT these bug^types. Although additional categorlas 
(Including execution Md efficfency bugs) aust be. defined to aake this taxonoay of . bugs 
vco'aplate, these clas^is are adequate to characterize aany exaap^es which arise In 

aleaentary prograaaing. m . ^ 

1 

rXiD is a d«rbugging assistant for SPApE*0 iapleaented on the basis of this 
taxonoay ^oTf errors^ As SPADE«0 proapts the uset* through planning process, Jliosa 
choices which aight lead to syntactic, seaantlc, or. pragaatic bugs are recorded by tha 
sys^tev. In subsequent debugging episodes, RAfb alerts the yser to the rel^vanl^ug 
wamirigs, thereby aiding in diagnosis. Moreover, the 8PADE-0 planning edittfr^can then 
ba re Invoked to giftfde repaii: of the bug by resualng irlannlng in the context of tha' 
culpable decision. An interaction with RAID that would arlse<froa preaature execution 
of a program Is Illustrated below: * [4 
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FIGURE 4 - SYNTACTICALLY I^4C0RRECT f'LAN 
A NECESSARY CONJUNCT IS MlSSINH 



TO WW •. 

10 TRIANGLE — ySE 



END 



■ID-PLAN 



• f 



WW GET 
??? TRIANGLE UNDEFINED ??? , 



("GET" MISSING. UNGRAMMATlCAL PLAN 
DEBUG BY COiyfPLETIWG PL^N. ) 



GET TRIANGLE FILE 



, FIGURE" 4 - SEMANTIC-ALLY INCORRECT PLAN- 

AN OPTLONAL CONJUNCT IS MISSI-NG 

FpR-E-XAMPLE: "WW" MISSING INITIAL, SETUP , AND INTERFACE FOR lOKP 



TO WW 

10 WELL MAINSTEP-i 

20 POL-E —MAINSTEP- 



"-SEQ-PLAN 



end? here 



it 



starts hero 



FIGURE 4 - PRAGMATICALLY INCORRECT PLAN 
AN INCORRECT DISJUNCT HAS BEEN SELECTED • 



TO SQUARE-'iNSIDE-TRIANGLE 
10 SQUARE 
"20. TRIANGLE- 
END 



INTENDED ^ICTURE 
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LINEAR PLAN 
SQUARE AND TRIANGLE 
DESIGNED- 
' INPEI^ENDENTLY. 

ACTUAL ri gTUI^E: 
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The irser ii9s continued dfjinyg t^e mi^kingmell profrtm begun earlier, *U*. 
Us current definition as shomn^U^^. ib. Altbotiik an^initial SETUP end en 
IKTBUFACE heve not yet been sutpiied, tM user refu^sts execution of the 
prof ram. ' . - 

1«. ... What now? ; ' 

lb. >Rpm<I5HINCWELL.\ . * * \ / / ' 

2a. OK. - ^ (Fi9 4b shoms t*e muZttirg ptttare J | 

. Vhat now? . 
Zb. >Plaonose 

3al The rule Is: DIAGN05E-> <Pj«5t | CODE | BODELJ PROCESS)*. ^ 
Vhat now? - , - / . 

^ 3b. >Parse ^ - ^ * ' 

4a. The rule li: PARSE -*> S¥^AX hSEfWNT^CS j PRAOHATICS. 

What now? - \ ^ 

4a. >SeBantlC9 • > . . ' I , ' 

• • •• t , . / 

Sa: The following optional coristltu^ts are alsslng In WW: 

The SETUP and the INTERFACE between WELL -and POLE. 

What now? ^ / . 

5b: >Repalr * / - - 

^ 6a. The. rule Is: REPAIR -> COHPLETE" | REPLACE. * 
6b. >Co«pleta Interface between well and poleT 

.7a. The, rule 1$: PLAN -> IDeAtIFY | 0ECOHPOS£ .| REFORHULATE 

7b . > . . . . ' ' ' 



In this axaapla. ihe interaction with SPADE was again guided by a gra«Mr; this 
debugging graiMr Is given below. . 16 

ERjC ' <^ • , , •• ' ■ ' . 
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DIAGNOSE - 

PROCESS 

COD£ 

nODEL 

PARSE 

SYNTAX 

SEMANTICS 

PRAGMATICS 

REPAIR 

COHPLETE 

CORRECT 

RUN 

ASK 

TRACt 

SEii^DOC 



•> < PARSE I CODE I NODEL | PR0CE8S>* . 
-> <ASK I TRACE>* 
->-"prli»t derinltlon* 
•> RUN . y 
•> sVnTAX I. SEMANTICS | PRAGMATICS ^ 
-> "review conjunctive ctiolces in plan" 
^> "review optional choices in plan," 
-> "review disjunctive choices in plan" 
-> COnPLETE I COf^ECT 
-> "solve for aissing conjunct" 
"cho<^se alternative dfisjunct" 
-> "run code line" ♦ ["errormsg"] ♦ [DIbUG] 



"^rltrV^inition.* I Vint value" 
-> [SELF-DOC*] ♦ RUM* 

-> <^add .break" | "add prini" | "add trace" 



This ,graflMr represents the traditional debugging strategies eaployed by progrMMrs 



suppleaented by the PARSE-based stfategi^s JiUowed by the Existence or (ht SPADE 



dfrivation tree. 



For Bore coaplex prograas, there will be 'too aany potential bug locations for 

Hence, following ^PADE-O's stmcturerf 



RAID's undirected advice to bef helpful. 



bookkeeping philosophyt we al^ow the user to set caveats during planning regarding 
those decisions which appear to be potential trouble spots. In this fashion, SPADE 
penilts an exploratory style of problea solving, as illustrated below. 

Suppose the mishingwelX progrem is pert oj e lerge project. Then the number 
0/ optionel constituents thet heee net been defined mill be lerge. The user ^ 
mill probeblg hewe some insight into which of tlihse is ectuellg needed. Jo 
fecilitete debugging, the user \s encouregef to piece ce-eeets et tAose 
decisions^he suspects ^neg reguire later debugging. 

6a. Do you wish to include the optional initial SETUP in WW? 
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' 7«. Do you wish to record a caveat -here? 
7b. >Yes. ' 

* • 

8a. OK. Your pendlntf goals are ROOF, POLE and WELL. 4ftiat now? 
8b. > ... ' 




ERIC 



Another Mtchanlsv to m^p SIDE'S and RAID's advice sore directed Is to supply tha 
seMt^s for probleas. This is^e tbplc/of the next section. 

6. PATW An Augaented Transition Network for Planning 

Wlrlle conte)(t free graaaars can^reprasent a useful abstraction of planning' 
decisions, they have liaitatlons which prevent thea froa providing a complete theory of 
design, ^ey provide no ^representation for the seaintlcs of the problea nor for the 
prergaatics Involved In choosing one plan over another. For this r«ason^*wa hav% 
designed and are currently lapleaentlmg PATN, an augaented tr^sltlon network (ATM) 
problea solver. We have, adopted the ATH^^oraallsa for the saae reasons that Woods 
[1970] to Introduce It into coaputatlonal linguistics: the seaantlc andyragaatlc 
lialtatlons of context free graaaars. fjj^ 

J 

\ FI9. 5 'provides a global view of PATH [Goldstein ft Hlller 1976b]. The topology of 
the network eabodies the planning gr'aaaa^. .Registers contain descript4ons of the 
problea,, the solution, and various^ teaporary constructs built during planning* Arc 
, predicates supply pragaatlc guidance by exaalnlng the registers and appropritftaly 
^directing tha' planning .process. Fo^ exa^>le, an Identification plan cannot procaad if 
the problea description carinat be foupd In the answer library. PATN has bean 
successfully hahd-slaulatad on eleaentaiir Log^^ and Blocks World problems. 

PATH allows us to elaborate our notion fof ff coapleted plan by defining an 

eaaototed tferivottoji tree. Associated with eacn node of the plan derivation ia a 

I 

snapshot of the values of the ATN registers at the point In the planning process whan 
that . node was created. A derivation 4ree reveals the constituent structure of tha 
^ plan; these ieiaojitic MrUiles reveal the seaantlc Intknt. A sat of assertioMS at 
aach' node, darlved as Instances of PATN^s arc predicates, reveal the pra^ivatic r09$0M 
tor prefarring a given plan o>er Its coapetltors« Fig. 6 %hows the annotatad 
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ABBREVIATIONS. 



f^: MODEL 
P=:PLAN 
A-sADVICE 
G-:60AL / 



■ID 



: PLAN-LI BRARY(M) 



LINEARIZATION 
LOOP 



A-A a: CONSTRAINT.' 

, I 

M-LINEARIZE (M) 



M€ LIBRARY 
' (1) 



EXPLICIT (M) 
(1) 




PLAN 




de:c 





(2) 




RMULATE (M) 



REFINEMENT I ' 

LOOP :GOAL -FIRST :-60ALS 

, : GOALS-REST : GOALS 

: PLAN-: PLAN + S0LVE•(M-G)^3 



.INTERACTIONS' (M) 
III] ^ 

(2) : GOALS-ORDER A) 
. :PLAN-SE9(M.A) 




(2 



GOALS= 
NIL 






GENERIC (M) 










REP 




4 


f 





Example Registers ; 

Register M - Predicate logic problem description 
Register A - Advice about goal Interactions 

Example Conditions ; 

, Mc Library - "Is problem description matched by 

^ anything In the answer library?" 

Generic (M) - "Is the problem description repre- 
« * * sen ted as a generic element?" 

Example Act 16ns ; 

S^Llbi;ary(M) - "Return the solution found In. the i 
answer library," J 
M^Reformulate(M) - "Replace model with altematl9iB 

problem ^^scrlptlon. v 

; 
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FIGURE 5 A- Slf^PLIFIED VIE»? OF PATN 

I ' 



So 




-|/J «" £ : MODEL }■ INTErXcTIONS(X)) 



SOLVE (WV^) PLAN DEC ' 



SEQ 




-,(:hC)DEL6 ANS-LIB) ! 



:MDDEL- (3 ROOF, POLE, WfiLL^" 
TRIAIJGLE (ROOF) ' / 



A LIME (POLE) 



A SQUARE (WELL) \ 




r SETUP— . . MDENTIFY— PRIMITIVE - 
-MAINSTEP (WELL) . .-DEFINED ■ 



- INTERFACE ... DEC : ' 

MAINSTEP (POLE)^. . .IDENTIFY" 

■INTERFACE ^ 



DEF 



^- MAINSTEP (ROOF) — 



A ABOVE, (ROOF POLE)\ ( 
A ABOVE ^POLE WELL) 



.A ^...) 



V-' 

/ :MODEL - (J( 3.VECT0R(X) 
v/ LENGTM'(X)-IPO) 

: MODELS ANS-LIB 



NED 




■CONuJ . .SEQ 

-I^RIMITIVE '. . . 

I- SETUP . . 
-SEQ --MAINSTEP, 

-CLEANUP, 



repetition 





EOl ? TO WW 

E02 >10 RIGHT 90 

E03 *>20 WELL 

E04 >30 FORWARD 50 

EO5 >40 LEFT 90 

E06 >50 FORWARD 100 

E07 >60 LEFT 90 ^ 

EOS >70 FORWARD 50 

E09 >80 RIGHT 120 

EIO >90 ROOF 

EII >END 

E12 ? TO WELL ^ 

El5 >I0 REPETkT 4 (20 30] 

E14 >20 FORWARD 100 '* 

El 5 >30 RIGHT 90 

EI6 >END .' 



XA 

W 
H 

% 



FOR<-0,3isiDEt ^- VECTOR(SIDE c) a LENGTH ('S I DEt). 



100 ^CONNECTED (SIDEi. SIDE t+1 MOD 4) J 




EI3 >I0 RKPEAT 3 [20 30] 

CI 9 >20 FOR'WARD 100 

E20 >30 RIj3HT 120 

E21 >END 



/ 
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FIGURE 6 -PATN'S KmotJUdd DERIVATION TREE FOR THE VJISHIIJGWELL' TASK 
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7 ' > ; • ^ 

' derlviftion tre« for the wishinowell prograa given Mrlitr. 



An Intended application of PATN is as a aodulex^f the^ SPADE editor for ^rovldilno 
the juser with additional direction and advice Thf following hypothetical dMlogu^ 
with SPADE-1 (the SPADE editor augMnted by PATN) illustrates this'. 

la.- Tell M the naBe/of^youF- toplevel procedure? ' 



1)^ >VW 



Za. Would you like to.define a Mdel7 * 
2b. >VISHINGWEIL 

3a. OK. WISHINGWELL aodel found in^odel Lil^ry., The rule is: 

PLAN -> IDENTIFY | DECOHPOSE | REFORnVtAjkv Whit no«7 
3b. >ROOF POLE WELL 



4a. These subgoals correspond to aodel parts. 

Are you pursuing a LINEAR DECOHPOSITION plan? 
4b. >YES 

The pending subgoals are: ROOF, POLE, WELL and the preparatory steps. 
What now? ^ 
8b. >R0OF ^ ^ 



6a. In l^r WW nodel, ROOF is described as a triangle. 

There is a TRIANGLE procedure in the answer library. 

Would you like to use it? ^ - 

"6b. >YE5. * / • * ' . 

7a. OK. The ROOF. is coaplete. Your pending goals are: 
^POLE, WELL» and the preparatory steps. What now? 

7b, > ... ' 

I 

PATN's Linearization Loop provides a theoretical Superstructure for handliirg 
dependent, interacting subgoals^ Thfi approach is to view a non-linearity as k property 
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of the problm description. That Is/even though one description of the problea leads 
to fn ilhsuccessful reflneMnt process because of Interactions between subgoalsp another 
description cao succeed by making the dependent constraints explicit. For exeaple» 
consider the SQUARE -INS IDE -TRIANGLE of fig. AZ. If the problea description Is: 

SQUARE X; ,s . ' 
. ' TRIANGLE Y; . ' , v . 

JNSIDE X Y; 0 

then a decoaposltlon that draws the square and triangle Independejntly* and then atteapts 
to Clt then together' to achieve the Inside relation will fail* However', a problea 
description of the following pom ''allows a successful decoaposltlon: 

SQUARE X, WITH sIdE « 100; ^ , 

. TRIANGLE Y, WITH SIDE » 300;; - > ' 

CENTER OF X « CENTER OF Y. 

The INTERACTIONS 'predlcexe is a conjunction of tests on the aodel register. Each 
test is responsible for detecting a given non-linearity. A corresponding action 
•bdlfles-the model, adding new stat^inents to nake the interaction explicit. The 
REFINEMENT loop Is the repository for wflat Sussun [1975] calls the Critics Gallery. 
The^ theoretical progress of PATN is to Integrate the Critics Gallery concept into, t 
theory of planning. In Sussnan's HACKER, the critics gallery and library of 
programing techniques were separate aodules: there was no Integrated theory. 

Of course, at any point in tlae the system may be unaware of a given type of non- 
-linearity. In such cases, the absence of an interaction test will lead te a sequential 
decomposition that ultimately falls. The design of a program for debugging such 
falluras Is^ the^^subject of^e next section.* 

> i- 

7. DAPR --An Augmented Transition Network for Debugging 

»PATN cm Bik* Blttikts. That Is, >ATN will soMtlMS Introduce >whit wt t«ni 
r«tioii«{ »uf4. Into Us plans, du« to Mklng arc tranitltlons with lapcrfac^t knowledo* of 
subt^«tUs or Inttractloni In tha task dOMln. Htnce, PATN Mst be equipped with a 
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coBplMMiitacy debugging ■odvlt, DAPR (fig. 7).' 

Whilt RAID was designed to assist hunan prograaitrs in finding a variety of bugs 

(prlMrily by plan diagnosis), DAPR was designed to^analyze PATN's buga. DAPR eapLDys 

three diagnostic ^'techniques: Bodel/ process, and plan diagnoses. Model diagnosis is 

the basic technique. It aabunts to coaparing* the effects of executing a plan to a 

fonaal description 'of its goals, to detemine if, and^in what fashion^ the plan has 

failed. Another. DAPR technique, based on Sirssnan ' s^HACICER [1975]* is exaninihg the 

state of the process at the tim of the error nanifestation. , Plan diagnosis is i DAPR 

first. It is , acconplished by examining the qoveats variable associated with various 
> , * ' ■ 

nodes of PATN*s annotated ^lan deriv^tioti. 

'A • 

DAPR will also be used to provide additional guidance to RAID. This illustrates 
the synergism possible when e^Sucational, psychological and AI facets of a cognitive 
theory are studied in an integrated fashion. This integrfeition is further exeaplifled 
in the* next sectidn when we apply the SPADE theory to protocol analysis. j 

V f 

8. PAZATW, an Autonatic Protocol Analyzer ' 

As soon as one t^as an heuristically adequate theory of design, it is natural to 
ask, 'Can >the theory provide an account of how people j;olve.fproblens7^ . An^ 
oxperlnental technique we employ for answering this question is the analysis of 
protocols collected 4if/ing pir})bleB solving sevens. By adopting this jsethodology we 
follow the precedent este^ishexl in seainal protocol analysis studies conducted at 
Carnegie, nellon Univeryity [Newell/aTTiaon 1972; Wateraan ft Newell J972, ^ 1973} 
Bhaskar\ft Simon 1976]. Our work Extends their approach along thcpe dimensions. 

1. With the excepl^ion of iK^Nrecent Bhaskar A Simon effort, the cnu studies have 
been restricted to very limited domains such as cryptarithmetic.^ Rather than limiting 
the task domain, we limit ' the range of responses. Typically protocols are 
transcriptions of think-aloud verbalizations; we focus on the more restricted 
interactions arising from a problem solving session at a computer console. The 
analysis task in this setting is to interpret u$er actions editing, ex^utlno* 
tracing, etc. in terms of the SPADE theory of planning and debugging. 
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(EXfSTfe (MOI^L-ST^ATEMENT STEP.JLOC) 

(AND (MEMBER (NEGATE MODEL-STATifMENT) ( tVtOLATIONS LOC) ) 
(EQUAL MODEL-STATEt!ENT (: MODEL STEP) ) 
(MlS^Wr; SXFP frPLAN LOC)))) 



(EXtST^(STEP LOC) ^ 

(AND (OPTIONAL STEP) 

(MISS;NG step (:PLArl LOC)))) 




:VIOLATlONS"^( INTERPRET rCODE tMODgL) 
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-FIGURE 7 Dj^R; PATll'g DEBUGGIKG ATM 
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2. The CNU theory centers the production system model. Although productions 
•re Turing universal, they tend to result in e less structured progran organization 
than the linguistic-forBalisais of the SPADE theory. In PATN, each arc transition^ 
consisting of a .predicate and an action, can be thought oT as a production. Howevor» 
PATN organizes these productions into local contexts, each of which consists of tha 
arcs exiting froa a given node. Not all of the arc productions are present at any 
Booient in tlae; an arc is present only when the problea solver Is at the relevant 
noda. In the production systems discussed in Kumen froblem Solving [Newell ft 
SiMn 1972^ all of the protluctions are always present and are tested in s#r ial order. 

3. Cnu analyses are based on the problem behavior graph. Pursuing an analogy to^ 
coBputationalFlinguistics, we define an Interpr'etation of a protocol to be a parse tree 
supplemented by semantic ahtf pragmatic annotation. The parse tree characterises the 
constituent structure of the protocol. Semantic and^ragmatic annotation --Variables 
and assertions attached to nodes of the parse tree formalize the problem description 
and the rationale for particular planning choices. Annotated parse trees closaly 
reflect the loda^s$tructure of PATN's linguistic problem solving machinery, loading 
■ore directly to inferences regarding individual differences than is evident from 
problem "behavior graphs* 



Ruven Brooks [ 1975] applied the CNU approach 'to the programming domain^ 
developing a model of coding the translaTtion of high level plans into the statements 
' of a particular programming language and testing the model by analyzing protocols. 
His model is a set of production rules whose conditions match the patterns of plan 
•lemants and whose actions generate code statements. Protocols are anitlyzed manually* 
with thQ experimenter attempting to infer the plan which is then expanded by .the 
production system /Into code paralleling that of the protocol. ' Tht processes of 
understancfing the Airolrteli, generating the plan, and debug*ging are not formallzad. 
^PADE ftoas beyond this in that It can be used to parse protocols and that the parse 
constitutes a formal hypothesis regarding not only the coding knowledge but also the 
planning and debugging strategies employed by the problem solver. 

[Miller ft Qi^ldstein 197C^] provides a detailed example of such analysis being 
performed by ban d t^e'^amp le is a segment from a l^rotocol several hundred lihet long 
lA which a. high school student uses the kogo turtle to draw the letters of his 
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ty •xaalnlng the graHiar rules present In the derivation^ we can readily observe' 
various /properties of the student Upjoblea solving such as: reliance on certain 
planning choices to the exclusion of ot^irs (e.g.». the student employed iteration^ but 
never recursion); the alsus^e of certain ^tlonal constituents (e.g.» a setup was 
usually Included ^In each ^|^cedure even when ' it was unnecessary); and certain 
situations where his problen Solving ^violates the graoMr and hencf is susceptible to 
.syntactic errors 7e>9«f prograBs were often executed before their subprocedures had 
been* defined). 

Just as a context-free vravur is incomplete as a theory of planning^ liliewise a 
parse is only a partial analysis of a protocol. The theory of annotation developed in, 
the PATN work led us fron destrlbing only the jyntoctic structure to iiore coaplete 
analyses of protocols: an interpretation of a ptrotocol is the selection of a 
particular eaaotetetf PATN plan derivation. Fig. 8 shows such kn analysis of a 
siaplif led protocol in which a wi^hingwell progras is defined, #3tecuted and debuoo^d. 

. ^AZATN is a chart-based ifarser Cl^ay 1973; Kaplan 1973] being Inpleaented to 
Interprat protocols in t^rns of PATN's annotated plap derivations [Hillar ft 
Goldstein 1976d]. It will ot)erate by causing PATN to deviate froa its preferred 
approach in response to botton-up evidence (fig. 9)*. By taking advantage of powerful 
parsing strategies developed in research on speech understanding [Lesser et al. 197S; 
Paxton ft Robinson 1975], as well a$ the econoaical chart representation of aablguities, 
•PAZATN has been successfully^hand*siBulated on approxiaately 10 Logo protocols. 




PAZATN will operate by^aatchihg .PAT^-generated plans with protocol, data. Two 
charts will be used to represent alternative fnterpretatiohs. The PLANCHART keeps 
track of the set of vlausible subgqals w||ich have been proposed by PATN. Fig. 10 shcms 
a ilanchart for^ wisl^lfvgwell in whlcJr PATN has proposed two alternative 
decdapositions • The structure is a chart because it shares substructures, as 
exeaplified by the cooBBon' solution, to the WELL subgoal poin^d to by both wis^ngwell 
•decoapositions . The DATACHART records the state of partially coapleted 
iifterpretations. Fig. 11 shows how the datachart links events into the planchart for a 
PAZATN interpretation of the wishingwell protocol ijgiven earlier. 

These charts are^growh as follows. First PAZATN requests PATN to generate its 



iJK€ : model (WW) INTERACTIONS (X) 




pSolve {*TREE*) 



Ref . . . Plan . . POtiJ-SEQ. 



I J r ^ANS-UB 7 

T-((:MODEL p6lE) A (:HODEL R( 



Solve (TREE)-(a£Aeadt/ de^c4)^ 
repetitio; 

i-Solve (WELL) 



Jolve (■*WELLJ 




■^" N US< 



user-subr-call 



subr-call 



lEOl ?T0 WELLt 
Ea2 >10 REPEAT 4 [20 30] 
E03 >20 FORWARD 100 , 
E04 >30 RIGHT 90 

!E05 >ENE)! 

IeJs ?T0.WW! 
E07 >10 TREE 
■ EOS V20 WELL 
1E09 > EmL 



. • ^^■^ ^ 

OPTIONAL (INTERFACE (TREE WELL)) A MISSING(INTERFACE(TREE W^ LIQ) J) 



Debug 



Diagnosis Model-diagnosis 



Repair Complete Solve (INT-TW>/ 

• = El 3 >15 FORWARD 50 



'E14 >17 RIGHT 180 



!E15 >END.' 



:VI0L3^0NS'-l5 P J^ONNECTED(WELL TREE (AT P)) 

A P-MIDDLE (UPPER(SIDE(WELL))) 
A ...) 



FIGURE 8 ABBREVIATED STRUCTURAL DESCRIPTrON FOR WW 
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FIGURE 9 TOP LEVEL ORGANIZATION OF THE PROTOCOL ANALYZER/ 
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SEQ- 
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- SOLVE (POLE) 



SOLVE •(ROOF) 



SPLIT 
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SPLIT 
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SOLVE (POLE) 



L SOLVE (WELL) 
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FIGURE 10 PLANCHART OF ALTERNATIVES FOR WW 
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Rlanchart 



-DECOMPOSE 



SOliVE-«« • 



SPLIT 




- Datnchort 



DEF OFWW^ y^^^ 
V- HUNG * 



E01=t»JJF OF 
/WELL 




E06=DgF OF WVi 



^>SOLVE(TRrffe) IDENTIFY. . . 



PLAN 



•-REFORMULATE 



-SEQ — 



SOLVE (WELL)H5EC-REP. 



'DEBUG 



MODEL DIAGNOSIS^' 




E07=CAEL TO 



TREE 



EOO=CALL TO 
WELL 
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DIAGNOSIS ^ 



-REPAIR-^COMPLETE-SOLVR ( INTERFACE 
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FIGURE 11 DATACHART LINKING PROTOCOL EVENTS TO PLANdHART LEAVES 
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most pltusible p»aU'. This plan is inserte^into the PLANCHART. Then protacol tvents 
•r« analyied one by one, and aatched with subgoals in the PATN plan,. The Battl^ Is 
racorded In the DATACHART. If no plausible Batches afe found, PATN is asked to 
0«n«rate the next most plausible plan. Th« PLANCHART i» thereby extended. CoMon 
subgoals share the s^ structure in the, chart. , ' " 



At first, PAZATN will be iapleaented Interactively, with the user m 
psychologist analyzing a prbiocol directing PAZATN to select different PATN plans. 
This follows the increaental iapleMfttation strategy used In two of the CffU protocol 
analyzers [VaterMn ft Newell 1972; Bhaskar ft Siaon 1976]; PAZATN, even in its early 
interactive stages, should provide strong evidence regardirtg PATN's adequacy as a 
cognitive theory.. 

* . * ' » , 

I 

PAZATN Will also be tested in the SPADE context. Below is a hypothetical dlaloffu* 
with SPADE-2. representing the joriginal SPADE-0 augMnted by both PATN p^d PAZATN. 

'A ' '• . , 

We are now solving for a WISHINGWEL|.. Your pending subgoals are: 

ROOFl POLE, WELL, and the interfaces. What now? 
lb. >SQUARE . , ' t. 

' . ■ ■ ' " ■ r ' 

2a. OK. I aa assuaing that WELL has been solved by identifying it • 

with the previously solved SQUARE procedure. Whait now? 
2b. > ... * - 

PAZATN will increase the editor •» flexibility in han(|ling aabiguous events, and In 
allaviatino tfhat aight seea to soae users to be an excessive allocation of ,tlM and 
•ffort to the planning phase. Ultiaately we expect SPAD|-2 to provide a prograailno 
•nviromMnt of value to professional as well as student prograHrars: 

— ' 9. Conclusions ^ 

• ^ ' • * 

kn outline of the SPADE th«ory of design has been presented. One theae has baen 
the synarglsa achievable in a aulti-faceted research effort. Prograas have been 
dasigned and are be|ng iapleaented for testing ^PADE in educational, psychological and 
AI contexts. The AI dlaension involves the developaent of a spectrua of posslblt 
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thtorlas of cognition.' 1^9 psychelooica) . md, •ducatlbnil dliwnslons supply feedback 
regarding which parts of a theory are rejected by coapetent hwaan problfa solvers. 
Furtheraore, the psychological dlaenslon would be incoaplete were it not to address the 
Isstte of learning, while the educational dlMnsion characterises the trajectory of the 
student's cognitive ;itate throu(^ tine. 

A stcond thtae has been tht txploltation of conMpts atid algorithBS fraa 
coaputational linguistics: grasMrs, JilU*%, dariyation traasp saarch strategies froai 
speech understandingp chart-based parsers. Coapotational lingirlstics is elso 
responsible for^^^stiTniesting the propitious decoaposition of problem solving processes 
In^to coaiponents involving syntactic, sewntic l^jj^ragMtic knowledge. • 

We believe thet our unified approach to AI, psychology and education represents m 
new rMssrch paradiipa offering the potential for considerable progress in all three 
fields. But auch resains. to be dona. Although all of the progress have been designed 
end hat^sUsiauiatad, only the 8PADE-0 editor has been Ispleaented. Furthenaore, while 
SPADE has been applied to Logo graphics, blocks wor^l and eloMntary calculus probleasg 
It has not yet^^een^ exercised in enough contexts to prove Its generality. If tMs 
resperth project succeeds, a new clarity will have been-broeght to the study of problea 
solving. Even if^it fails, the reasons for the failures should provide useful 
insights. In any case, it has already unified the treataent of plans end bugst t 
significant stride for a theory of problaa solving. 
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